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(54) Camera with keystone distortion correction 

(57) The present invention relates to the correction 
of planar focus in an electronic still or video camera (20). 
The camera comprises: a detector array (34); an objec- 
tive lens (21 ) arranged to direct optical radiation from an 
object plane (26) onto the detector (34), the lens (21) 
defining an optical axis (22) of the camera and the object 
plane (26) being at an oblique angle (28) to the optical 
axis (22); movement means (32,33,44) to change the 
relative orientation of the detector (34) with respect to 
the lens (21 ) so that the detector (34) and lens (21 ) may 
be moved relatively toward or away from each other 
along the optical axis (22) and also tilted with respect to 



each other with at least one degree of freedom; and fo- 
cus detection means (38) connected to the detector (34) 
to detect when a portion of an image falling on the de- 
tector (34) is in focus, The camera (20) also includes a 
processor means (38) to control the movement means 
(32,33,44) according to the detected focus, the proces- 
sor means (38) bringing the image into focus on the de- 
tector (34) by first changing the relative orientation of 
the lens (21 j and detector (34) until a first portion of the 
image is in focus, and then holding said first portion in 
focus whilst continuing to change the relative orientation 
of the lens (21) and detector (34) until a second portion 
of the image is also in focus. 
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Description 

[0001] The present invention relates to the correction 
of planar focus in an electronic still or video camera. 
[0002] Desktop flat bed scanners are very common in s 
office imaging applications. Although these are relative- 
ly inexpensive and work well, a disadvantage is that 
these invariably take up a significant amount of desk 
space, which is always at a premium. 
[0003] Digital camera products are becoming com- 10 
mon in many areas of still and motion photography, and 
as a result are becoming ever less expensive. However 
such cameras are still used almost exclusively for pho- 
tography of people or places, and have yet to be adapt- 
ed for use in office imaging applications This is because 15 
electronic cameras, which normally employ two dimen- 
sional CCD arrays, have insufficient resolution to image 
a complete A4 page at 300 dots per inch, the minimum 
that is conventionally believed necessary for reasonably 
high quality reproduction. Whilst larger CCDs are avail- 20 
able in electronic cameras, they aie much too expensive 
for a mass-market office imaging product. 
[0004] A camera mounted over the desk and looking 
directly downwards could image documents on the 
desktop, avoiding this permanent waste of space. In or- 2s 
der to obtain sufficient resolution with the limited number 
of available pixels, the camera would need to be directly 
above the document to be imaged, so that all of the doc- 
ument was in best focus. This, however, is inconvenient, 
requiring either that a user lean directly over the docu- 30 
ment or that a frame is provided over the desk on which 
the camera would be mounted. An overhead camera 
could obstruct a user's headroom or be inadvertently 
knocked. 

[0005] Alternatively, if the camera were not directly 35 
above the document but, say. held or mounted at near 
an edge of the desktop, then not all of the document 
would be in focus simultaneously because the docu- 
ment would not be at right angles to the optical axis of 
the camera. Owing to the loss of resolution due to the 40 
camera's limited depth of field, only a part of the docu- 
ment would be captured with sufficient resolution in one 
frame. This is inconvenient, because a user or some 
type of mechanical actuator would then have to manu- 
ally pan and tilt the camera to take a number of overlap- 4 & 
ping pictures, each with a magnification high enough to 
obtain sufficient resolution, and subsequently "stitch" 
these pictures together using software. 
[0006] There is also the additional problem that the 
image would be distorted owing to the oblique viewing 50 
angle, an effect referred to herein as "keystone distor- 
tion". Although such perspective distortion can readily 
be rectified using well-known image processing tech- 
niques, this does result in non-optimal resolution over 
the portions of the image where a printed character is 55 
spread over fewer pixels. 

[0007] Conventional approaches to addressing these 
problems suffer from other limitations. Greater depth of 



field can be provided by reducing the camera aperture 
but this lowers the amount of light at the image plane, 
which raises noise levels. A greater exposure time will 
not work with hand-held photography, owing to camera 
shake. Active or electronic image stabilizers add to cost, 
and are not fully effective at eliminating the effect of 
camera shake. A frame and mechanical mounting to 
hold and pan/tilt the camera can eliminate camera 
shake, but with a significant penalty in terms of mechan- 
ical complexity and cost. Even with a small aperture, or 
longer shutter time, it is difficult to obtain the necessary 
depth of field to operate down to an angle of less than 
.45 degrees, as may be desirable with an electronic cam- 
era held or mounted at the edge of a desktop. 
[0008] For many years, photographers have under- 
stood that under certain circumstances as defined by 
the Scheimpflug condition, it is possible simultaneously 
to focus on several things at different distances from the 
camera, providing that all the objects of interest lie on a 
flat plane. When the Scheimpflug condition is satisfied, 
the object plane, image plane, and a plane passing 
through the lens, all intersect along a line. Whilst this 
condition is necessary for correct focus, it is not, on its 
own, sufficient. Setting up a camera to focus on a tilted 
object plane has up to now been regarded as requiring 
a tripod mounted large format view camera and the skill 
of a professional photographer. 

[0009] Professional photographers using such large 
format cameras can, with practice and an intuitive un- 
derstanding of three dimensional geometry, achieve the 
Scheimpflug condition, and adjust the angle of the lens 
and/or the image plane in order to focus on a scene that 
has an area of interest in a plane at an oblique angle to 
the optical axis. Conventionally, this is done by viewing 
the image projected on a ground glass screen in the 
camera, whilst adjusting the relative orientation of the 
lens and image plane to focus on the object plane of 
interest. 

[0010] Although this principle has been known for 
many years, Scheimpflug cameras have remained man- 
ually operated and large format. One attempt to partially 
automate a Scheimpflug camera is described in patent 
document US 4 564 277. This however, describes a 
camera suitable for professional film photography and 
which may have a ground glass screen tor viewing an 
image. The process is only semi-automated, requiring 
a photographer to move an image plane perpendicular 
to the optical axis to at least two locations where differ- 
ent areas, of the screen are in focus, and enter (x.y.z) 
position data for these locations into a calculator, which 
from the known focal length of the lens, can then calcu- 
late the correct orientation of the lens or image plane to 
meet the Scheimpflug condition. Such a camera and 
process are not sufficiently inexpensive, quick or con- 
venient for a mass-market desktop imaging product. 
[0011] It is an object of the present invention to pro- 
vide an electronic camera that addresses these prob- 
lems. 
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[0012] Accordingly, the invention provides an elec- 
tronic camera, comprising: a detector array; an objective 
lens arranged to direct optical radiation from an object 
plane onto the detector, the lens defining an optical axis 
of the camera, and the object plane being at an oblique s 
angle to the optical axis: movement means to change 
the relative orientation of the detector with respect to the 
lens so that the detector and lens may be moved rela- 
tively toward or away from each other along the optical 
axis and also tilted with respect to each other with at 
least one degree of freedom: and focus detection means 
connected to the detector to detect when a portion of an 
imago tailing on the detector is in focus, characterized 
in that the camera includes a processor means to control 
the movement means according to the detected focus, 
the processor means bringing the image into focus on 
the detector by first changing the relative orientation of 
the lens and detector until a first portion of the image is 
in focus, and then holding said first portion in focus whilst 
continuing lo change the relalive orientation of the lens 
and detector until a second portion of the image is also 
in focus 

[001 3] The term "lens" as used herein is not restricted 
to a single lens element and includes lenses with com- 
pound optical elements. 

[0014] The focus detection means may be any of the 
known automatic focusing techniques that are found in 
digital or film-based still or video cameras. These in- 
clude range finding techniques based on the transmis- 
sion and reception of reflected infrared pulses. Addition- 
al focus means may also be employed, for example 
those relying on reflected ultrasonic pulses. Other 
known techniques that involve some sort of statistical or 
frequency domain analysis of the detected image, are 
particularly appropriate when the object is imaged elec- 
tronically, rather than with photographic film, as with vid- 
eo or digital still cameras. 

[0015] Acoustic and, particularly, infrared range find- 
ers are very directional. It would be possible to fit three 
of these to the camera pointing in different directions 
within the field of view. The position of a plane is defined 
by the position of three non-collinear points. Knowing 
the position of the object plane, the required angle of 
the image (or lens) plane could then be calculated di- 
rectly by 3-D geometry. With the simplification dis- 
cussed above only two range finders would be needed. 
[001 6] The detector may be any type of electronic de- 
tector, in particular a two-dimensional CCD array or 
CMOS array. 

[0017] Assuming a reasonably designed lens, what- 
ever the position of the image or lens planes, the image 
is a perspective projection of the original object. Thus, 
any straight line on the object plane is also a straight 
line on the image plane. A consequence of this is that it 
is unnecessary to go through the procedure described 
in US 4 564 277 to determine the position of the image 
plane and then, from this and a knowledge of the focal 
length, calculating the required positions of the lens and/ 



or image planes using Scheimpflug's rule. It is sufficient 
to adjust the focus directly. No calculation of the position 
of any of the planes is required. Neither is it necessary 
to know the focal length of the lens. 
[0018] Preferably, the processor means brings the im- 
age into focus by first moving the lens and detector rel- 
atively towards or away from each other along the opti- 
cal axis until the first portion of the detector is in focus, 
and then holding said first portion in focus whilst tilting 
with respect to each other the lens and detector until the 
second portion is also in focus. 

[0019] When the image of an object in an object plane 
oblique to the optical axis comes into focus on the de- 
tector, the object, lens and detector satisfy the Sche- 
impflug condition. The lens may become mechanically 
complicated if it has to be correctly positioned both for 
a general or rough focus by moving in and out with re- 
spect to a camera body, as well as having to be tilted. 
Although it is possible to move the plane of the lens 
through a number of positions meeting the Scheimpflug 
condition until the position of best focus is found, it is 
preferred to leave the lens in a fixed position and move 
the detector to the image plane in order to meet the 
same condition, because this may be mechanically sim- 
pler and lends itself to be performed automatically. 
[0020] Therefore the lens may be movable along the 
optical axis with respect to the camera body, with the 
detector being movable with respect to the body at least 
to tilt the detector with respect to the lens. Optionally, 
some small amount of general focus may be provided 
for by the detector by movement of the detector along 
the optical axis without tilting. 

[0021] Alternatively, and particularly in the case 
where the operating focus distance is always within well- 
defined limits, say of the order of 0.2 m to 2 m in a desk- 
top imaging application, the lens may be fixed relative 
to the body, with the detector being movable with re- 
spect to the body along the optical axis and to tilt the 
detector with respect to the lens 
[0022] In either case, the detector array will then be 
physically moved by the movement means, for example 
being mounted at comers on linear actuators that allow 
the detector to move backwards and forwards and also 
tilt with respect to the optical axis. If the camera is to be 
used in an application where essentially only one de- 
gree of tilt freedom is needed, for example if a document 
to be imaged will always be directly in front of the camera 
on a surface tilled relative to the optical axis about a line 
at right angles to this axis, then it need have only one 
degree of tilt freedom. A consequence of this simplifica- 
tion of camera motion is that there is a corresponding 
simplification in locusing motion, requiring only two de- 
grees of f reedom: linear movement and tilt in one direc- 
tion. This results in simplification of processor control as 
well. 

[0023] However, in most cases, it is envisaged that 
the camera may have to cope with an object tilted about 
a line not at right angles to the optical axis. Therefore. 
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the detector and lens may be arranged so that these can 
be tilted relative to each other with two essentially or- 
thogonal degrees of freedom. The processor means 
then brings the image into focus by first bringing the first 
and second portions into focus, and then holding said 5 
first and second portions in focus whilst tilting with re- 
spect to each other the lens and detector until a third 
portion of the image is also in focus. 
[0024] In a second embodiment of the invention, an 
electronic camera comprises additionally: a second lens io 
disposed between the objective lens and the detector 
and arranged to direct optical radiation from an image 
plane of the objective lens onto the detector, the second 
lens defining an internal optical axis of the camera that 
intersects the optical axis of the objective lens: and a is 
rotation means to change the relative orientation of the 
second optical axis and the optical axis of the objective 
lens, the processor means being adapted to control the 
rotation means in order to improve detector keystone 
distortion in the image plane of the second lens. 20 
[0025] The above term "improve" means in this con- 
text either ameliorating or eliminating keystone distor- 
tion. 

[0026] Surprisingly, it is in principle possible to elimi- 
nate keystone distortion whilst at the same time bringing 2s 
the image of the tilted object into focus on the detector 
by satisfying a double Scheimpflug condition, one for 
each lens. In addition, this can be done automatically by 
the processor means, using the focus detection in the 
detector portions mentbned above, and knowledge of 30 
the focal length of the both lenses, and the separation 
between these lenses. 

[0027] Specifically, the camera may comprise com- 
prises memory means holding data representative of: 
the focal length of both the objective and second lenses, 35 
and the separation of the lenses when the axes of the 
lenses are aligned. The camera then comprises means 
to determine the relative orientation of the detector and 
the second lens when the portions of the image are in 
focus and to generate data representative of said orien- 40 
tation. Finally, the processor means can be arranged to 
calculate from said focal length, separation and orien- 
tation data a relative orientation of the objective lens, 
second lens and detector that will focus the object plane 
onto the detector whilst at the same time improving key- ^5 
stone distortion. 

[0028] In the case where the object plane is tilted 
about a line at right angles to the objective optical axis, 
the rotation means may need only one degree of free- 
dom. In general, however, the second optical axis may so 
be rotated with respect to the first optical axis with two 
essentially orthogonal degrees of freedom. 
[0029] The electronic camera described above may 
be used in a desktop imaging application, in place of a 
flatbed scanner. Such an imaging device may have a 55 
mount, for example a pole or bracket clampable to an 
edge of a desk, by which the camera may be mounted 
above the edge of the desk and directed down onto the 



desk in order to image a document on the desk. 
[0030] A desktop imaging device positioned above 
and to one side of a work surface on a desk naturally 
takes advantage of the Scheimpflugcondition because 
the desktop is inherently a flat plane. 
[0031] Also according to the invention, there is pro- 
vided a method of imaging an object, using an electronic 
camera comprising a detector array, an objective lens 
arranged to direct optical radiation from an object plane 
onto the detector, the lens defining an optical axis of the 
camera, movement means to change the relative orien- 
tation of the detector with respect to the lens so that 
these may be moved relatively toward or away from 
each other along the optical axis and also tilted with re- 
spect to each other with at least one degree of freedom, 
and focus detection means connected to the detector to 
detect when a portion of an image falling on the detector 
is in focus, the method comprising the first step of point- 
ing the camera at the object so that the object plane is 
at an oblique angle to the optical axis : characterized in 
that the camera includes a processor means to control 
the movement means according to the detected focus, 
and in that the method comprises the additional steps of: 

i) using the processor means to bring the image into 
focus on the detector by first changing the relative 
orientation of the lens and detector until a first por- 
tion of the image is in focus; and then 

ii) holding said first portion in focus whilst continuing 
to change the relative orientation of the lens and de- 
tector until a second portion of the image is also in 
focus. 

The method may also be adapted to the case where 
it is desired to improve keystone distortion in an 
electronic camera having a second lens, as men- 
tioned above. Therefore, when the processor 
means is adapted to control the rotation means, the 
method comprises the step of: 

iii) using the processor means to change the relative 
rotation of the second optical axis and the optical 
axis of the objective lens in order to improve detec- 
tor keystone distortion in the image plane of the sec- 
ond lens. 

[0032] When the camera comprises memory means, 
and means to determine the relative orientation of the 
detector as mentioned above, the method comprises 
the step of: 

iv) storing in the memory means data representa- 
tive of: the focal length of both the objective and second 
lenses, and the separation of the lenses when the axes 
of the lenses are aligned; 
and after step ii) the steps of: 

v) using the processor means to calculate from said 
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focal length, separation and orientation data a de- 
sired relative orientation of the objective lens, sec- 
ond lens and detector; and 

vi) using the processor means to change the rela- 
tive orientation of the objective lens, second lens 
and detector in order to focus the object plane onto 
the detector whilst at the same time improving key- 
stone distortion. 

[0033] The invention will now be further described, by 
way of example, with reference to the accompanying 
drawings, in which: 

Figure 1 is a schematic drawing of a lens with an 
object plane and an image plane satisfying the 
Scheimpflug condition; 

Figure 2 is a schematic drawing of an electronic 
camera according to a first embodiment of the in- 
vention, with microprocessor driven focus and de- 
, tector tilt actuators to achieve the Scheimpflug con- 
dition; 

Figure 3 is a schematic view of a desktop imaging 
device using the electronic camera of Figure 2 to 
image an A4 size sheet of paper on a desk; 

Figure 4 is a schematic drawing showing two lenses 
with an object plane, an intermediate image plane, 
and a final image plane satisfying a double Sche- 
impflug condition; 

Figure 5 is a schematic drawing showing the same 
lenses of Figure 4 satisfying another double Sche- 
impflug condition consistent with a second embod- 
iment in which keystone distortion is removed from 
the final image plane; and 

Figure 6 is a schematic drawing of an electronic 
camera according to a second embodiment of the 
invention, that may achieve the double Scheimpflug 
condition of Figure 5 in which keystone distortion 
may be removed whilst at the same time achieving 
focus of a tilted object plane across a detector. 

[0034] Figure 1 shows schematically the Scheimpflug 
condition, in which a lens 1 has an optical axis 2, and a 
planar object 4 is in an object plane 6 lying on the axis 
2 tiled at an acute angle 8. The object 4 is separated 
from the lens 2 by a distance S greater than a focal dis- 
tance f of the lens. A lens plane 10 perpendicular to the 
optical axis 2, intersects object plane 6 along a line rep- 
resented by point 12 in the drawing. An inverted planar 
image 1 4 of the object 4 will then form on the optical axis 
2 and lie in an image plane 16 that is separated by a 
distance S' from the lens. The image plane 16 intersects 
the object plane 6 and perpendicular plane 1 0 along the 



same line at point 12. 

[0035] In Figure 1 , m is the slope of the object plane 
6 and m' the slope of the image plane 16. The normal 
lateral magnification of this system is therefore -SYS. 
5 When the object plane 6 and image plane 1 6 satisfy the 
Scheimpflug condition, then the object plane and image 
plane must intersect on the lens plane 1 0. If the distance 
between the point of intersection 12 and the optical axis 
2 is c, then: 

10 

m = -c/S and m' = c/S' so m' = -nrS/S'. 

[0036] For a typical lateral magnification of -1/1 5, m = 
is -15m. 

[0037] Reference now is made also to Figure 2. This 
shows schematically an electronic camera 20, having a 
body 19 in which a lens 21 images an object 24, lying 
on an object plane 26 at an acute angle 25 on optical 

20 axis 22, onto a two dimensional CCD detector array 34 
lying on an image plane 36. The detector array 34 is 
square and, although not shown in detail, two actuators 
32,33 are mounted to move diametrically opposite cor- 
ners of the detector 34 which then pivots under the ac- 

25 tion of the actuators about an intermediate corner so that 
the actuators provide two independent orthogonal de- 
grees of freedom in tilting the detector 34 relative to the 
lens 21. 

[0038] When the object plane 26 is 20° away from ver- 

30 tical then its slope is -tan(70) = -2.74. With a lateral mag- 
nification of -1/15 the slope of the image plane 36 will 
be 41 .21 which is only 1 .39 degrees away from the ver- 
tical. For a typical CCD sensor 10 mm on a side rotated 
about its centre this represents a displacement of only 

35 5»sin(1 .39) = 0. 12 mm at a corner of the detector 34. 
[0039] This is a relatively small displacement, which 
can be provided for with correspondingly compact actu- 
ators 32,33. The invention therefore benefits from the 
fact that electronic detectors are small, certainly com- 

40 pared with large format photographic film. 

[0040] The detector 34 provides an output 37 to a mi- 
croprocessor 38 for the image captured by the detector. 
The microprocessor 38 is also has output lines 40,41 ,42 
used to drive the detector actuators 32,33 and a lens 

45 focus actuator 44. 

[0041] In general, a memory 46 may be connected to 
the microprocessor 38, and the camera 20 will have a 
sufficiently low average power consumption, that it may 
be battery powered from a removable or rechargeable 

50 battery 46. Digital input/output lines 50,51 allow the 
camera to be interfaced with a personal computer (not 
shown). 

[0042] Focusing may be detected with the aid of the 
microprocessor 38. The actuators 32,33 can be control- 
55 led by a derivative of one of the known automatic focus 
methods, preferably one of the image statistical or fre- 
quency domain techniques. There are various focus ar- 
rangements that are suitable. For example, one existing 
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f1: 


Focal length of objective lens 1 




f2: 


Focal length of second lens 71 




S1: 


Object distance from objective lens 1 




M1: 


Magnification of lens 1: M1 = f1/(f1+S1) 




S2: 


Distance of image formed by lens 1 from lens 71 
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M2: 


Magnification of lens 71 : M2 = f2/(f2+S2) 




K: 


Angle of inclination of object with respect to opti- 






cal axis of lens 1 




P: 


Angle between optical axes 2, 202 of lenses 




Q: 


tilt of detector 214 relative to optical axis 2, 202 


15 


R: 


Angle of inclination of the intermediate image 114 



9 

method achieves sharpest focus by adjusting to maxi- 
mize the variance of the pixels read from the detector 
34. Optionally, by providing three actuators behind the 
CCD assembly, one in the centre in addition to the two 
32,33 on adjacent edges or opposite corners, it is pos- 
sible to provide full control of the position of the image 
plane, so that at least some of the total focus capability 
may be provided by the detector 34. The image variance 
may be measured separately in two or three regions, 
depending on the number of degrees of freedom ol the 
detector movement: the position of the central actuator 
being regulated by the focus of the central region and 
the two sides by corresponding regions along the two 
edges Incorporating each of these corrections into a 
closed loop control system including the microprocessor 
38 results in Scheimpflug condition autofocus. 
[0043] Figure 3 shows how the electronic camera 20 
may be used to capture an image of a piece of A4 size 
paper 54 resting on the surface 56 of a desk 58. The 
camera 20 is mounted atop a post 60 that is clamped 
62 to an edge 64 of the desk 58. A mount 66 pivotable 
about a horizontal and a vertical axis connects the post 
60 to the camera 20. so that the camera can be pointed 
manually to any part of the desk surface 56. Because 
the camera 20 is at the edge of the desk 58, the rest of 
the desk surface 56 is free as a work surface or for the 
placement of other office equipment such as a printer or 
a personal computer. 

[0044] Reference is now made to Figure 4 and a sec- 
ond embodiment of the invention illustrated in Figures 
5 and 6. 

[0045] As is known, when the object and image plane 
for a single lens meet the Scheimpflug condition the im- 
age is in sharp focus. However the image is distorted 
owing to the oblique viewing angle of the object. To re- 
move this keystone distortion a second lens 71 is added 
to the arrangement described above. Initially, the optical 
axis 2 of the objective lens 1 is coaxial with the optical 
axis 202 of the second lens 71 . This makes the image 
plane 1 6 and image 1 4 described above respectively an 
intermediate image plane 116 and intermediate image 
114. The detector 214 can then be placed in an ultimate 
image plane 21 6. Again, the detector 216 can be moved 
to satisfy the Scheimpflug condition, as shown in Figure 
4. 

[0046] The image on detector 216 will still suffer from 
keystone distortion, but Figure 5 shows how this distor- 
tion can be eliminated by rotating together the second 
lens 71 and detector 216 about an axis at right angles 
to and through the objective lens axis, and through the 
intermediate image plane 114. 

[0047] The following description explains mathemati- 
cally how this can be accomplished. 



R = ArcTan{-M1-Tan(K)} (1) 

20 [0049] Focus and zero keystone distortion is achieved 
when: 

ArcCos{f2*Cos[R]/(f1*M1-M2)} + R - 180 (2) 

25 

[0050] Rotating the axis by the angle given by formula 
(2) above and then rotating the sensor to satisfy the 
Scheimpflug condition gives an image that has no key- 
stone distortion and is in sharp focus. 
30 [0051] For example, consider an object with: 

S1 = 400 mm from lens 1 and angled at 70° (K) 

f1 = f2= 12.12 mm 

M1 = -1/32 

35 M2 = -2 

[0052] Formula (1) above gives R = 90. 65°, and so 
from formula (2) ; P= 11.14°. 

[0053] A method for achieving the double Sche- 
40 impflug focus condition with no keystone distortion is as 
follows. 

[0054] First, the optical axes 2, 202 of the two single 
Scheimpflug stages are aligned, as in Figure 4. Then 
the detector is moved in the same way as lor a single 
45 Scheimpflug stage to get the object into sharp focus. As- 
suming that the orientation of the second lens and de- 
tector can be measured or determined, this then gives 
the distance S2\ and the tilt of the detector 214 relative 
to the optical axis 2, 202. Since we know the focal length 
50 of the second lens 71., we can use the lens equation to 
calculate S2 = S2W2/(f2 - S2'). 
[0055] From the lens equation, M2 = f2y(f2+S2). 
[0056] Using the magnifications we can work back 
from the tilt of the sensor to work out the tilt of the inter- 
55 mediate image using the inverse of the single stage 
Scheimpflug formula (1) to get: 
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R = ArcTan{(-1/M2)Tan(Q)} (3) 

[0057] This data is substituted into formula (2) to find 
the correct alignment for the second stage with respect 
to the first. All these calculation steps can, of course, be 
performed by a microprocessor, which will also be con- 
trolling the motion of actuators. 

[0058] Figure 6 shows schematically how in a second 
embodiment of the invention a double Scheimpflug elec- 
tronic camera 80 may work. Features common with 
those of the first embodiment illustrated in Figure 2 for 
convenience share the same reference numerals. The 
second embodiment 80 differs from the first embodi- 
ment mainly in the provision of a second lens 91 mount- 
ed inside the camera body 1 9 on pivots 81 ,83 that define 
a single axis of rotation of the second lens 91 . The sec- 
ond lens 91 is held in a tube 84 that also holds the de- 
tector 34, so that both the second lens 91 and detector 
34 pivol in unison. The arrangement allows keystone 
distortion in one direction to be cancelled. If keystone 
distortion in different directions is needed, then a two- 
axis gimbal mount could replace the simple pivots 
81,63. 

[0059] The microprocessor and actuator arrange- 
ment of Figure 6 differs from that described for the first 
embodiment of the invention in Figure 2, in that the mi- 
croporcessor keeps track of the degree of displacement 
of the objective lens 21 , and the angular orientation of 
the tube 84 and tilt of the detector 84. 
[0060] The practical arrangement inside the tube 84 
can be thought of as a single lens planar Scheimpflug 
focus unit as previously described consisting of iens and 
moving detector 34. This unit 84 can be rotated about a 
point corresponding to the intermediate image between 
the lenses 21,91. 

[0061] The invention has been described herein as 
being applicable to overhead scanning or documents. 
However, there is no reason why the invention should 
not be applied to hand-held cameras. The invention is 
not limited to capturing images on perfectly flat planes 
either. In any case where there is a dominant plane 
present the invention could provide advantages to the 
user. For example, many landscapes require great 
depth of field but the foreground, in particular, may be 
fairly flat. Thus the main plane will be roughly horizontal. 
Similarly, pictures of buildings may have a vertical main 
plane. By making more than the minimum three focus 
measurements it would be possible automatically to de- 
termine if there was an appropriate object plane and, if 
so, focus on it or, if not, focus according to some default 
procedure. As mentioned above, professional photog- 
raphers using expensive equipment are able to exploit 
these possibilities today with large format tripod mount- 
ed cameras and the exercise of their skill. By removing 
the element of skill the invention may permit any pho- 
tographer using a digital camera to do the same. 



Claims 

1. An electronic camera (20), comprising: a detector 
array (34); an objective lens (21 ) arranged to direct 
5 optical radiation from an object plane (26) onto the 
detector (34), the lens (21 ) defining an optical axis 
(22) of the camera and the object plane (26) being 
at an oblique angle (28) to the optical axis (22); 
movement means (32,33,44) to change the relative 
10 orientation of the detector (34) with respect to the 
lens (21 ) so that the detector (34) and lens (21 ) may 
be moved relatively toward or away from each other 
along the optical axis (22) and also tilted with re- 
spect to each other with at least one degree of f ree- 
ls dom; and focus detection means (38) connected to 
the detector (34) to detect when a portion of an im- 
age falling on the detector (34) is in focus, charac- 
terized in that the camera (20) includes a processor 
means (38) to control the movement means 
20 (32,33,44) according to the detected focus, the. 

processor means (38) bringing the image into focus 
on the detector (34) by first changing the relative 
orientation of the lens (21 ) and detector (34) until a 
first portion of the image is in focus, and then hold- 
25 ing said first portion in focus whilst continuing to 

change the relative orientation of the lens (21) and 
detector (34) until a second portion of the image is 
also in focus. 

30 2. An electronic camera (20) as claimed in Claim 1 , in 
which the processor means (38) brings the image 
into focus by first moving the lens (21 ) and detector 
(34) relatively towards or away from each other 
along the optical axis (22) until the first portion of 
35 the image is in focus, and then holding said first por- 
tion in focus whilst tilting with respect to each other 
the lens (21 ) and detector (34) until the second por- 
tion is also in focus. 

^0 3. An electronic camera as claimed in Claim 2, in 
which the detector (34) and lens (21) can be tilted 
relative to each other with two essentially orthogo- 
nal degrees of freedom, the processor means (38) 
bringing the image into focus by first bringing the 
45 first and second portions into focus, and then hold- 
ing said first and second portions in focus whilst tilt- 
ing with respect to each other the lens (21 ) and de- 
tector (34) until a third portion of the image is also 
in focus. 

so 

4. An electronic camera as claimed in any preceding 
claim, in which the camera (20) has a body (1 9), the 
lens (21) being movable along the optical axis (22) 
with respect to the body (19), and the detector (34) 

55 being movable with respect to the body (1 9) at least 

to tilt the detector (34) with respect to the lens (21 ). 

5. An electronic camera (20) as claimed in any one of 
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Claims 1 to 3, in which the lens (21) is fixed relative 
to the body (19), and the detector (34) is movable 
with respect to the body (19) along the optical axis 
(22) and to tilt the detector (34) with respect to the 
lens (21). 5 

6. An electronic camera (80) as claimed in any pre- 
ceding claim, in which the camera (80) comprises: 
a second lens (91 ) disposed between the objective 
lens (21 ) and the detector (34) and arranged to di- 10 
rect optical radiation from an image plane (114) of 

the objective lens (21) onto the detector (34), the 
second lens (91) defining an internal optical axis 
(82) of the camera (80) that intersects the optical 
axis (22) of the objective lens (21); and a rotation 15 
means (81 ,83) to change the relative orientation of 
the second optical axis (82) and the optical axis (22) 
of the objective lens (21 ), the processor means (38) 
being adapted to control the rotation means (81 ,83) 
in order to improve detector keystone distortion in 20 
the image plane (216) of the second lens (91). 

7. An electronic camera (80) as claimed in Claim 6, in 
which the camera (80) comprises memory means 
(46) holding data representative of: the focal length 25 
of both the objective (21) and second (91) lenses, 
and the separation of the lenses (21 ,91 ) when the 
optical axes (22,82) of the lenses are. aligned, 
wherein the camera (80) comprises means (38) to 
determine the relative orientation of the detector 30 
(34) and the second lens (91 ) when the portions of 
the image are in focus and to generate data repre- 
sentative of said orientation, the processor means 
(38) being arranged to calculate from said focal 
length, separation and orientation data a relative 35 
orientation of the objective lens (21), second lens 
(91) and detector (34) that will focus the object 
plane (6) onto the detector (34) whilst at the same 
time improving keystone distortion. 

40 

8. An electronic camera (80) as claimed in Claim 6 or 
Claim 7, in which the second optical axis (82) can 
be rotated with respect to the first optical axis (2) 
with two essentially orthogonal degrees of freedom. 

45 

9. A desktop imaging device, comprising an electronic 
camera (20) and a mount (60,62,66) by which the 
camera (20) may be mounted above an edge (64) 
of a desk (58) and directed down onto the desk (58) 

in order to image a document (54) on the desk, in so 
which the camera (20) is as claimed in any preced- 
ing claim. 

10. A method of imaging an object (24), using an elec- 
tronic camera (20) comprising a detector array (34), ss 
an objective lens (21 ) arranged to direct optical ra- 
diation from an object plane (26) onto the detector 
(34), the lens (21) defining an optical axis (22) of 



the camera (20), movement means (32,33,44) to 
change the relative orientation of the detector (34) 
with respect to the lens (21 ) so that these may be 
moved relatively toward or away from each other 
along the optical axis (22) and also tilted with re- 
spect to each other with at least one degree of free- 
dom, and focus detection means (38) connected to 
the detector (34) to detect when a portion of an im- 
age falling on the detector (34) is in focus, the meth- 
od comprising the first step of pointing the camera 
(20) at the object (24) so that the object plane (26) 
is at an oblique angle (28) to the optical axis (22), 
characterized in that the camera (20) includes a 
processor means (38) to control the movement 
means (32,33,44) according to the detected focus, 
and in that the method comprises the additional 
steps of: 

i) using the processor means (38) to bring the 
image into focus on the detector (34) by first 
changing the relative orientation of the lens (21 ) 
and detector (34) until a first portion of the im- 
age is in focus; and then 

ii) holding said first portion in focus whilst con- 
tinuing to change the relative orientation of the 
lens (21) and detector (34) until a second por- 
tion of the image is also in focus. 

11. A method of imaging an object as claimed in Claim 
10, in which the camera (80) comprises: a second 
lens (91) disposed between the objective lens (21) 
and the detector (34) and arranged to direct optical 
radiation from an image plane (1 1 4) of the objective 
lens (21) onto the detector (34), the second lens 
(91 ) defining an internal optical axis (82) of the cam- 
era that intersects the optical axis (22) of the objec- 
tive lens (21); and a rotation means (81,83) to 
change the relative orientation of the second optical 
axis (82) and the optical axis (22) of the objective 
lens (21 ), the processor means (38) being adapted 
to control the rotation means (81 ,83), wherein the 
method comprises the step of: 

iii) using the processor means (38) to change 
the relative rotation of the second optical axis (82) 
and the optical axis (22) of the objective lens (21 ) 
in order to improve detector keystone distortion in 
the image plane (216) ol the second lens (91). 

1 2. A method as claimed in Claim 11 , in which the cam- 
era (80) comprises memory means (46), and means 
(38) to determine the relative orientation of the de- 
tector (34) and the second lens (91 ) when the por- 
tions of the image are in focus and to generate data 
representative of said orientation, the method com- 
prising the step of: 

iv) storing in the memory means (46) data rep- 
resentative of: the focal length of both the objective 
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(21 ) and second lenses (91 ), and the separation of 
the lenses (21 ,91 ) when the axes (2,82) of the lens- 
es are aligned; 

and after step ii) the steps of: 

5 

v) using the processor means (36) to calculate 
from said focal length, separation and orienta- 
tion data a desired relative orientation of the ob- 
jective lens (21 ), second lens (91 ) and detector 
(34); and 10 

vi) using the processor means (38) to change 
the relative orientation of the objective lens 
(21 ), second lens (91 ) and detector (34) in order 

to focus the object plane (6) onto the detector is 
(34) whilst at the same time improving keystone 
distortion. 
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